To maximize or not to maximize the free energy of glassy systems, !=? 
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The static free energy of glassy systems can be expressed 
in terms of the Parisi order parameter function. When this 
function has a discontinuity, the location of the step is deter- 
mined by maximizing the free energy. In dynamics a transi- 
tion is found at larger temperature, while the location of the 
step satisfies a marginality criterion. It is shown here that in 
a replica calculation this criterion minimizes the free energy. 
This leads to genuine first order phase transitions at the dy- 
namic transition point. Though the order parameter function 
is the same as in the long-time limit of a dynamical analysis, 
thermodynamics is different. 
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The theoretical understanding of systems with broken 
ergodicity has gained a lot from the study of spin glasses, 
see Mezard, Parisi and Virasoro, [1] and Fischer and 
Hertz [2] for reviews. The solution for the celebrated 
Sherrington-Kirkpatrick (SK) mean field spin glass [3] 
was formulated by Parisi. [4] [1] The order parameter 
is a function q(x) on the interval < x < 1. A non- 
constant form of q implies breaking of ergodicity. In the 
SK-model q has a continuous part followed by a plateau. 
Since it takes an infinity of values, replica symmetry and 
ergodicity are broken to infinite order. The free energy 
of the spin glass phase exceeds the continuation of the 
paramagnetic branch, as in real glasses. 

Recently a spherical spin glass model was proposed by 
the present author, which has the same critical behav- 
ior as the SK model, but can be solved exactly in the 
whole low-temperature phase. [5] The same shape of the 
order parameter function persists up to T = 0. As usual 
for classical vector spins or spherical spins, the entropy 
goes to minus infinity at low T. A recently introduced 
quantum version of the spherical model [6] improves this 
behavior. It is still solvable exactly and yields an entropy 
that is non-negative and vanishes at T = 0. 

Another canonical case, the one of interest in the 
present work, is that there occurs a one step replica sym- 
metry breaking (1RSB). Then q consists of two plateau's, 
q{x) = qo for < x < x\ and q(x) = q\ for x\ < x < 1. 
(In our present discussion the external field will vanish, 
which implies qo = 0.) This situation occurs, for in- 
stance, in the "simplest spin glass", namely the Ising spin 
glass with p-spin interactions for p — > oo, [7] in its spher- 
ical analog at any p > 2, [8] in the Potts glass, [9] in 
the binary perceptron, [10] [11] in a neural network with 
modified pseudo-inverse learning rule, [12] and in models 
for protein folding. [13] [14] According to the Parisi de- 
scription one looks for the maximum of the free energy as 



function of the break point x\. For T below some T g one 
finds a glassy phase that is usually stable against small 
fluctuations. The free energy exceeds the value obtained 
by continuing the paramagnetic free energy. The transi- 
tion is first order in the sense that the order parameter 
is discontinuous, but the latent heat vanishes, since, if 
finite, it would be negative. As such a transition takes 
place before the paramagnet becomes unstable with re- 
spect to small fluctuations, one has to assume that the 
paramagnet has some non-perturbative instability. [2] 

Recently there have been dynamical studies of the bi- 
nary perceptron by Horner, [15] and p-spin interaction 
spin glasses by Kirkpatrick and Thirumalai [16] and 
by Crisanti, Horner, and Sommers. [18] This revealed 
that also in dynamics a similar 1RSB transition occurs. 
However, it sets in at some T c that exceeds T g . It was 
noted [16] [17] that in the long-time limit the solution 
satisfies a marginality criterion, that is to say, the lowest 
fluctuation eigenvalue vanishes. Indeed, it is quite natu- 
ral that dynamics will get trapped in such a mode, if it 
can reach it. Therefore we wish to consider the marginal- 
ity not as some accidental property but rather as a funda- 
mental aspect. Using this criterion, we perform a replica 
analysis. We would like to think of our procedure as an 
"infinite-time limit". We stress that these times, though 
infinite, are much smaller than the ones needed to reach 
the static limit. As we shall see, the results obtained par- 
tially disagree with the ones of the long-time limit of the 
dynamical analysis. 

Let us start by noting that in the replicated partition 
sum one should integrate over all shapes of the order 
parameter q a p- In a saddle point approach one should 
thus consider all solutions of the saddle point equation 
of the replicated free energy, i.e. dF n /dq a f) = 0. For a 
1RSB solution the variations include variation w.r.t. to 
the value of the order parameter, dF/dq± = 0, as well as 
with respect its parametrization, i.e., dF/dx\ = 0. The 
latter is called the stationarity criterion. The validity of 
this procedure has been confirmed in the exactly solvable 
" simplest spin glass". [7] 

Let us now explain how the marginality condition 
shows up in a replica calculation. At any given break 
point x\ one can evaluate the free energy F(qi(xi); x\) 
by solving the extremality condition dF/dq\ = 0. By 
varying x\ between and 1 no local minimum is found. 
The minimal value of F is therefore set by one of the 
boundaries of the allowed x\ interval. The upper bound- 
ary x\ = 1 is not very interesting; it corresponds to a 
paramagnet. Since the free energy also has to be (at 
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least marginally) stable against small fluctuations, the 
lower extremal value of x\ is set by equating the lowest 
eigenvalue of the fluctuation matrix to zero, Ai(a;i) = 0. 
This is exactly the condition satisfied automatically in 
the dynamical solution of most systems mentioned above, 
see, e.g., [8] [16] [15] [18]. We have thus found that, by 
definition, the marginality criterion leads to minimiza- 
tion of the free energy. However, as discussed below, in 
some models the condition Ai = is never satisfied and 
there is only the static transition. 

We shall demonstrate our point on some specific mod- 
els. First consider the spherical p-spin interaction spin 
glass, as studied by Crisanti and Sommers (CS). [8] For 
a system with N spins the Hamiltonian reads 
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with independent Gaussian random couplings, that have 
average zero and variance J 2 p\/2N P ~ 1 . As shown by CS, 
the free energy for a 1RSB solution reads 
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where the first term describes the paramagnetic free en- 
ergy. Variation with respect to q\ yields 
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CS fixed x\ by requiring dF/dx\ = 0. We denote their 
transition temperature by T g . Adopting the marginality 
condition Ai = we obtain a transition temperature 
T c = J{p(p-2)P- 2 /2(p-l)P- 1 } 1 / 2 and x x = (p-2)(l- 
qi)/q\. In case p = 4, q\ can be solved analytically 
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T c exceeds T g for any p and has a finite limit as p — > oo, 
whereas T g ~ J / ^/p for large p. Near the transition the 
free energy is below the continuation of its paramagnetic 
value and has a larger slope. Thus one expects that a 
genuine first order transition takes place with positive 
latent heat, 
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When lowering T one first passes T g where the static 
solution sets in. In a dynamical approach nothing special 



will happen at this point, since one is and remains far 
from the static solution [18]; the same is expected for 
our "infinite-time" solution. Below some even lower T* 
the free energy of the marginally stable state exceeds the 
paramagnetic one. In principle one would then return to 
a reentrant paramagnet (x\ = 1). This phase, though 
stable against small fluctuations up to T = 0, cannot be 
the physical state at T = 0; it would lead to an internal 
energy that diverges as — 1/T for small T. This paradox 
can again be "solved" by assuming that states with free 
energy below the one of the marginally stable state have 
a non-perturbative instability. 

When comparing to the results from dynamics, [18] 
we see that the same order parameter function is ob- 
tained: the magnetic properties are the same as in dy- 
namics. This is no accident; it occurs since we adopted 
the marginality criterion. However, thermodynamics is 
ferent. Indeed, eq. (2) yields the internal energy 
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The first term is the energy occurring in dynamics. 
The term AU, proportional to dxi/dT, would cancel 
if x\ were determined by a stationarity condition. For 
the marginality condition that is not the case; at T c 
AU yields the latent heat (6). Crisanti, Horner, and 
Sommers [18] define the entropy by integrating dS = 
(C/T)dT from some temperature in the paramagnet, and 
obtain in this way the dynamical free energy. The result, 
rederived in an approach via the TAP equations, [19] 
reads 
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Whereas our "infinite-time" free energy lies below the 
continuation of the paramagnetic value, the long-time 
limit of the dynamical free energy exceeds it. It is in- 
triguing that the finite latent heat, derived by us, is not 
observed in dynamics. This unusual aspect of the first 
order transition is probably due to the divergent time 
scale 1/Ai. 

In Figure 1 we present the various free energies (af- 
ter subtraction of the paramagnetic value) for the model 
with random quartet couplings (p = 4). 

As second example we consider a spherical model with 
random pair and random quartet interactions having 
variances (J 2 ^ = J%/N and (J 2 jkl ) = Ul/N 3 . This 
model was studied recently by us [5], where we also al- 
lowed for inclusion of higher multiplet couplings. When 
the pair interactions are strong enough, a continuous spin 
glass transition occurs of the same type as in the SK 
model. The solution was derived explicitly at all T. Here 
our interest is for weak enough pair couplings. Then, as 
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in the above case with p = 4, J2 = 0, and J = J4/V2, a 
first order transition will occur to a phase with 1RSB. We 
can extend eqs. (2)-(4) to this situation for spins subject 
to the generalized spherical constraint (1/N) ^ S 2 = <r. 
This yields that the 1RSB transition point coincides with 
the continuous transition at T c = J20" when J2 = Ji<r/2. 
When J2 is below this value, there will be a frozen phase 
with 1RSB. In the quantized version of the spherical 
model [6] [5] the role of a will be taken by the self- 
overlap qd = q aa . This quantity, which has to be solved 
self-consistently, is temperature dependent and smaller 
than <t; this is a quantum effect. 

Let us take as next example the p-state Potts spin 
glass. The Ginzburg-Landau expansion of the n-fold 
replicated free energy was derived by Gross, Kanter and 
Sompolinsky (GKS) [9] 
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summed over all repeated indices 1 < a, /3, 7 < n, with 
q aa = 0. For p = 2 one has y = —2/3 so that this form 
reduces to the relevant part of the free energy for the Ising 
spin glass. It holds that y > for p > p* = 2.83. The 
phase diagram of this system was discussed extensively 
by GKS. For 2 < p < p* the solution has a plateau 
q = for < x < (p — 2)/2, then is linear up to some 
x\ and further has a plateau q\ ~ r up to x = 1. For 
such a solution the marginality criterion brings no new 
information, since it is satisfied automatically. 

For p > p* there is no (increasing) continuous solution. 
There are now two plateau's, qo = 0, and q\ > 0. In 
terms of S = (p — 4)/2 the free energy becomes 

PF = (1 - x^C-ql + S ~\ +Xl ql - \qt} (10) 
Stationarity with respect to q\ gives 
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GKS adopt the Parisi condition dF/dx\ = to fix 11. 
This leads to 

qi = -jr-(S+ V s2 + 5j/t) l-x 1 = + l^S 2 + 5t/r 
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Let us first consider p < 4, so S < 0. Close to the tran- 
sition one has q\ « r(l — 5<r)/|J|, 1 — x\ « |<£|(1 + 6<r), 
/3F « r 3 {l - 3cr + 21a 2 }/6\6\, where a = yr/46 2 . 

In our approach we need the lowest eigenvalues. For 
fluctuations on the qo and q\ plateau's they read 

3t/ 

A = -r+(l-a:i) 9 i Ai = -r - S qi + -j-q\ (13) 
respectively. For p<4we assume that Aq = 0. We find 
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so that Ai > 0. Near r = one has q\ « r(l — 4<r)/|J|, 
1 - x x k, + 4cr) and /3F « r 3 {l - 3cr + 20cr 2 }/6|(5|. 
Comparing to the static GKS solution, one sees that our 
"infinite-time" solution is different at order r 5 . Again, it 
has a smaller free energy. The free energy difference with 
respect to the state with Ai = is only of order r 6 . 

We now consider the situation where p is slightly larger 
than 4, p = 4 + 28 with < S < 1. Eq. (12) remains 
valid. As now S > 0, it is seen that the onset occurs 
at T g = —S 2 /9y, where x\ becomes below unity, while 
qi has a finite value. GKS thus predicts a non-standard 
first order transition with vanishing latent heat. 

Let us investigate the consequences of the condition 
Ai = 0. We now find an onset at r c = —S 2 /8y, occurring 
before T g . The solution reads 
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It can be checked that the other eigenvalues are positive. 
The free energy equals 



PF = ~ x 1 )q 3 1 [-S + 7(1 
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which clearly becomes negative at the transition. We 
thus find a genuine first order phase transition with a 
finite latent heat. At T g the static GKS solution sets 
in. The occurrence of this state has no effect at all on 
the dynamical solution or on our "infinite-time" solution. 
Below t* = — 4<J 2 /49y the free energy of the marginally 
stable state becomes positive. This behavior is fully anal- 
ogous to p-spin model, see the curves (a) and (b) in Fig- 
ure 1. Though the reentrant paramagnet is stable against 
small fluctuations up to r = 0, it cannot be the physical 
branch. Indeed, if it would, then at r = a new 1RSB 
solution should set in with Ao = 0. However, this one 
has a negative latent heat. Thus it cannot be the physi- 
cal solution, and neither can its paramagnetic precursor 
be. Fully analogous to previous situation we must assume 
that we can neglect the states with free energy below the 
one of the marginally stable state. Yet it remains to be 
shown that they are indeed unstable. 

We have also applied marginality criteria for finding so- 
lutions with a finite number of steps. This effort has been 
rather unsuccessful. For continuous solutions (infinitely 
many steps) the criterion is satisfied automatically. 

In conclusion, we have presented new "infinite-time" 
solutions of the mean field equations for glassy systems 
with a step in the order parameter function. These solu- 
tions are extremal in the sense that some fluctuations are 
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marginally stable. As compared to the commonly con- 
sidered static solutions, obtained by extremizing the free 
energy with respect to the location of the break point, it 
was shown that the marginality criterion leads to transi- 
tions with a lower free energy (when the q\ plateau sets 
continuously in from 0) or to transitions that set in even 
at a higher temperature (when q\ > but x\ becomes 
below unity). In all cases considered it was seen that the 
commonly considered static solutions have higher free en- 
ergy. 

There are also models where the fluctuations are al- 
ways massive. Then the marginality condition is never 
satisfied. Indeed, we found no application of it in the 
"simplest spin glass". In this problem there is no dy- 
namical transition point above the static one. This is in 
full accord with the fact that T c diverges in the p-spin 
interaction Ising spin glass. [20] 

It was found that our "infinite-time" replica calcula- 
tion gives the same order parameter function as dynam- 
ics in the long-time limit. However, the thermodynamical 
aspects are different. Most striking is that, in contradic- 
tion to the dynamical result, the free energy of the glassy 
state lies below the one of paramagnet. This discrepancy 
remains to be understood. 
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Note added: 

The difference between the free energy derived by us 
and its dynamical expression can be traced back to the 
value of the complexity. 
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FIG. 1. Free energy of a spherical spin glass with ran- 
dom quartet couplings, after subtraction of the paramagnetic 
value, a) "Infinite-time" solution; it sets in at T c . Its free 
energy exceeds the paramagnetic one below T* . b) Static so- 
lution; it sets in at T g . c) Long-time limit of the dynamical 
solution; it also sets in at T c . 
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